The ancient Sant’Angelo of Gaifa abbey, already operational in 1110, as a papal seal from Pope Pasquale the second attests, originally raised next to the Pieve of Gaifa, nearby Canavaccio in the territory of Urbino. During the 12th century, during the war between the Guelph and the Ghibellines, among many raids and fires, the monastery suffers a lot of damages that seriously compromise its viability. In 1277 the monastery has been rebuilt for more security by the abbot Giovanni, beyond the Metauro river, in the place where today it is located, in the court of Pagino, in the Municipality of Fermignano.

A latin inscription on the façade of the monastery indicates the reconstruction of the abbey in 1277 in this place. It is also the period of its maximum splendor.

After a period of absolute decline, the monastery in the second half of the 19th century was bought by the Lucciarini family of Fossombrone. During the transformation of the monastery as a villa, the architectonic structure was subjected to many changes. Only a wing of the big building with an annexed courtyard, where instead of the cells of the monks bigger rooms have been obtained, is left. The small church, incorporated to the building has been restored and today in some specific occasions the Mass is still celebrated.